chore(tests): add Opensearch integration tests by tstenner · Pull Request #24652 · vectordotdev/vector

tstenner · 2026-02-12T19:30:08Z

Summary

This PR adjusts the existing Elasticsearch integration test to also run the test against Opensearch 3.5.

As a very minor change it changes the automatic Elasticsearch version detection to detect Opensearch as version 7.

Change Type

Bug fix
New feature
Non-functional (chore, refactoring, docs)
Performance

Is this a breaking change?

Yes
No

Does this PR include user facing changes?

Overriding the Elasticsearch version to 7 is not needed any more for Opensearch.

Yes. Please add a changelog fragment based on our guidelines.
No. A maintainer will apply the no-changelog label to this PR.

References

Related: #17690 , #16761

github-actions · 2026-02-12T19:30:24Z

All contributors have signed the CLA ✍️ ✅
_{Posted by the CLA Assistant Lite bot.}

tstenner · 2026-02-12T19:33:11Z

I have read the CLA Document and I hereby sign the CLA

ts-ppi-1 · 2026-03-12T09:06:09Z

Rebased against master.

pront · 2026-03-26T20:02:30Z

@codex review

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1fb22c7764

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

pront · 2026-04-03T16:20:18Z

Hi @ts-ppi-1, please fix the merge conflicts and we will take another look at the PR. Thanks!

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: b5555a40ce

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

tstenner · 2026-04-04T08:42:43Z

Looks like an editor autoformatted some YAML files in a recent commit.

I have rebased the changes to the new formatting.

tstenner · 2026-04-09T19:27:58Z

Rebased the branch and rebuilt the certificates because the azurite integration test also added new certificates with the same serial number.

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 73aa987cb6

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

pront · 2026-04-13T14:00:46Z

@@ -0,0 +1,21 @@
+features:
+  - es-integration-tests


Suggested change

- es-integration-tests

This is needed because the integration tests are the es-integration-tests running against an opensearch instance instead of an elasticsearch instance

pront · 2026-04-13T14:01:32Z

 }

 #[cfg(feature = "aws-core")]
+#[cfg_attr(feature = "opensearch-integration-tests", ignore)]


Here and below:

Suggested change

#[cfg_attr(feature = "opensearch-integration-tests", ignore)]

Opensearch is missing the AWS authentication so this test has to be skipped

pront · 2026-04-13T14:03:00Z

+        ElasticsearchMode::DataStream => config
+            .data_stream
+            .as_ref()
+            .map(|ds| format!("logs-generic-{}", ds.namespace))


If we write here eventually, can we delete my-template-* / my-stream-* ?

I'd have to look into this. As of now, this is the smallest change I found back then that worked against both backends

pront · 2026-04-13T14:05:19Z

    /// Use the Elasticsearch 8.x API.
    V8,
+    /// Use the Opensearch 3.x API
+    OS3,


This basically V7 so I think we can delete this and just update the V7 docs.

At the moment, the OS3 code paths are the same as V7, but there it lays the groundwork to handle all minor differences (current and upcoming) and new functionality that does not warrant an entirely new sink.

pront · 2026-04-13T14:05:46Z

    let mut body = body.collect().await?.aggregate();
    let body = body.copy_to_bytes(body.remaining());
    let ResponsePayload { version } = serde_json::from_slice(&body)?;
+    if let Some(version) = version.as_ref()


If we do this https://github.com/vectordotdev/vector/pull/24652/changes#r3073522268, then we can delete all changes in this file.

Theoretically yes, but once we need special handling of Opensearch that does not yet warrant a separate sink we should have the groundwork ready.

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 3fa995b816

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7054892205

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector · 2026-06-03T11:26:42Z

+        data_stream: Some(DataStreamConfig {
+            namespace: index,
+            ..Default::default()


Align the data stream name with the test setup

When the new OpenSearch suite runs insert_events_in_data_stream, this data_stream config makes the sink derive the target as logs-generic-{index}, while the setup just above still creates an index template matching my-*-* and a data stream named my-stream-{index}. OpenSearch data streams need a matching data-stream index template for the target name, so the bulk writes go to an unprepared logs-generic-* stream and the test fails instead of exercising the created stream.

Useful? React with 👍 / 👎.

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 5d0adb2cd9

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

tstenner · 2026-06-19T08:52:06Z

Rebased against master

tstenner requested a review from a team as a code owner February 12, 2026 19:30

github-actions Bot added the domain: sinks Anything related to the Vector's sinks label Feb 12, 2026

tstenner force-pushed the feature/opensearch-integration branch 2 times, most recently from a298c6d to 22f4c6a Compare February 13, 2026 07:36

tstenner force-pushed the feature/opensearch-integration branch from 22f4c6a to 1fb22c7 Compare March 12, 2026 09:01

chatgpt-codex-connector Bot reviewed Mar 26, 2026

View reviewed changes

Comment thread Makefile

Comment thread tests/integration/opensearch/config/test.yaml Outdated

tstenner force-pushed the feature/opensearch-integration branch 2 times, most recently from 191e6ae to fd50c2f Compare March 27, 2026 07:19

github-actions Bot added the domain: ci Anything related to Vector's CI environment label Mar 27, 2026

tstenner force-pushed the feature/opensearch-integration branch from fd50c2f to b5555a4 Compare April 4, 2026 08:33

chatgpt-codex-connector Bot reviewed Apr 4, 2026

View reviewed changes

Comment thread tests/integration/opensearch/config/test.yaml

pront reviewed Apr 6, 2026

View reviewed changes

Comment thread src/sinks/elasticsearch/common.rs

Comment thread tests/integration/opensearch/config/test.yaml

pront approved these changes Apr 9, 2026

View reviewed changes

tstenner force-pushed the feature/opensearch-integration branch from 7a9fd98 to 73aa987 Compare April 9, 2026 19:27

chatgpt-codex-connector Bot reviewed Apr 9, 2026

View reviewed changes

Comment thread Cargo.toml

pront reviewed Apr 13, 2026

View reviewed changes

tstenner force-pushed the feature/opensearch-integration branch from 73aa987 to 3fa995b Compare April 20, 2026 17:21

chatgpt-codex-connector Bot reviewed Apr 20, 2026

View reviewed changes

Comment thread tests/integration/opensearch/config/test.yaml

tstenner force-pushed the feature/opensearch-integration branch from 3fa995b to 961f106 Compare April 20, 2026 17:36

tstenner force-pushed the feature/opensearch-integration branch from 961f106 to 7054892 Compare June 3, 2026 11:19

chatgpt-codex-connector Bot reviewed Jun 3, 2026

View reviewed changes

tstenner force-pushed the feature/opensearch-integration branch 2 times, most recently from b2ee261 to 5d0adb2 Compare June 4, 2026 11:06

chatgpt-codex-connector Bot reviewed Jun 4, 2026

View reviewed changes

Comment thread src/sinks/elasticsearch/mod.rs

tstenner added 9 commits June 19, 2026 10:48

feat(elasticsearch sink): add OS3 version for opensearch 3.x

f3d55c6

chore(dev): adjust integration test username+password for opensearch

eb05e75

chore(dev): add opensearch for elasticsearch integration tests

446a6f9

chore(dev): skip AWS auth tests against opensearch

42e3135

chore(dev): explicitly set index name for opensearch data stream tests

7c250e7

chore(dev): break events for opensearch in invalid event test

edf679a

chore: add changelog entry

974c091

chore(dev): add opensearch integration tests to CI workflows

aa88afb

chore: fix os3 deserialization (OS3 clashes with snake_case)

abd8ecf

tstenner force-pushed the feature/opensearch-integration branch from 2892e6f to abd8ecf Compare June 19, 2026 08:48

This comment has been minimized.

Sign in to view

tstenner and others added 2 commits June 25, 2026 16:53

Merge branch 'master' into feature/opensearch-integration

3369a24

chore: update docs

8e61082

tstenner requested a review from a team as a code owner June 25, 2026 14:54

github-actions Bot added the domain: external docs Anything related to Vector's external, public documentation label Jun 25, 2026

janine-c approved these changes Jun 25, 2026

View reviewed changes

Uh oh!

Conversation

tstenner commented Feb 12, 2026

Summary

Change Type

Is this a breaking change?

Does this PR include user facing changes?

References

Uh oh!

github-actions Bot commented Feb 12, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

tstenner commented Feb 12, 2026

Uh oh!

ts-ppi-1 commented Mar 12, 2026

Uh oh!

pront commented Mar 26, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

pront commented Apr 3, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

tstenner commented Apr 4, 2026

Uh oh!

Uh oh!

Uh oh!

tstenner commented Apr 9, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector Bot Jun 3, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

github-actions Bot commented Feb 12, 2026 •

edited

Loading